2024-01-29 10:48:51.AIbase.5.1k
Google's AI Chip TPU v5p is 2.8 Times Faster in Training LLMs than its Predecessor
Google has released the latest version of its flagship Tensor Processing Unit (TPU) for AI training and inference, challenging Nvidia's market dominance. The TPU v5p is Google's most powerful custom-designed AI accelerator, featuring 8960 chips per unit, which is double the 4096 chips of v4. The v5p TPU is 2.8 times faster in training large language models compared to the TPU v4 and offers 2.1 times the price-performance ratio. It is reportedly four times faster than Nvidia's A100 GPU in training tasks.
